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(54) Method and device for displaying image 

(57) A method for displaying an image is provided 
in which an optimal lighting pattern is selected so as to 
reduce pseu do contours and flickers. In an image dis- 
play for reproducing halftones by a subf rame technique, 
a frame is converted into plural subframes. For each of 
pixels of a display screen, the lighting pattern that is a 



combination of on and off of the subframes are deter-' 
mined in accordance with a frame data value of the not- 
ed pixel, a lighting pattem of the noted pixel in the past 
frame and the lighting pattern detemnined for the periph- 
eral pixel, located in the vicinity of the noted pixel and 
having the same display color as the noted pixel. 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0001] The present invention relates to a method and device for displaying an image in which a halftone is reproduced 
by controlling a lighting time per frame and is suitable for a display using a plasma display panel (POP) or an organic 
EL panel. 

[0002] A PDP has two features of high speed and high resolution that are suitable for a television set and a computer 
monitor. A PDP is used for a large screen display device. One of tasks about a PDP is to reduce a pseudo contour 
and a flicker of an animation display. 

2. Description of the Prior Art 

[0003] A halftone is reproduced in a PDP by setting the number of discharge times in a frame for a cell (a display 
element) in accordance with a gradation level. A color display is one type of a gradation display, and a display color is 
detemnined by a combination of luminance levels pf three primary colors. 

[0004] As a method of a gradation display using a PDP. a subframe technique is widely known in which one frame 
IS converted into a plurality of subframes having weights of luminance, and the total number of discharge times of one 
frame is set by combining on and off of the subframes (this is called a lighting pattern). Generally, the convereion from 
a frame into the subframes is perfomned by using a conversion table that was prepared in advance. In the case of an 
interiace display, each of fields making a frame is made of plural subfields. and lighting control is performed for each 
subfield. However, contents of the lighting control are similar to the case of a progressive display. 
[0005] In a display with the lighting control in a subframe unit, lighting subframes and non-lighting subframes are 
mixed, so a timing of the light emission becomes discrete within a frame period. As a result, undesired flickers and 
pseudo contours may be generated. For example, if the light emission is concentrated in thefirst half of a display period 
and IS concentrated in the second half of the successive frame of a certain frame, the time period of low luminance 
becomes long so that the distribution of the light fission along the time axis can be observed as a flicker to eyes of 
a human being. In addition, when displaying an image including an object that moves within a screen, the image of 
the noted cell moves on the observer's retina as the observer follows the object by hisy^er eyes. In this case if an 
image of a cell having low light emission intensltyfstays on a certain point on the retina coincidentally, the surface of 
the object may be seen in low brightness corresponding to the point. When such points are coupled on a line, a string- 
like pattern may be observed on the surface of the object, which is called a pseudo contour In other words, the pseudo 
contour is a phenomenon that an observer sees a light and dark pattem that is different from the display contents and 
IS apt to be generated especially when an image portion made of pixels having a similar gradation level and a gentle 
gradient of density moves in a screen. For examjjie. in a scene of a person walking, a portion of his/her face can 
generate a pseudo contour. j 

[0006] Conventionally, a method for reducing flickers and pseudo contours is known, in which the weighting is per- 
formed so that plural sets of subframe expressions can be realized for a halftone, and an optimal subframe expression 
is selected for each gradation level noting each frime. The basic concept of optimizing the subframe expression is to 
maintain a barycenter of light emission in a frame period without a substantial change corresponding to the gradation 
level as disclosed in Japanese unexamined patent publication No. 1 0-307561 . For example, the barycenter of the light 
emission is set to the middle of the frame period. If the barycenter of the light emission is constant, the Interval between 
the light emission barycenters of the frames also becomes constant, so that uneven distribution of the light emission 
timing such as a long period of low luminance carl be eliminated. 

[0007] In addition. Japanese unexamined patent publication No. 1 1 -224074 proposes a method comprising the steps 
of noting a certain frame (i.e.. the present frame) for detemnining a lighting pattem, referring a lighting pattem of a 
previous frame, and selecting an optimal lighting pattem considering the relationship between the previous frame and 
the present frame. By this method, the pseudo contours can be reduced more securely than the method in which only 
the present frame is noted for determining a lighting pattem. In addition, Japanese unexamined patent publications 
No. 9-172588 and No. 2000-105565 propose a method in which the lighting pattem is determined by considering a 
lighting pattem of the neighboring cell. By making the lighting pattem change as little as possible among the neighboring 
cells, the generation rate of the pseudo contours can be reduced. 

[0008] As explained above, there was a problem that if the lighting pattern is determined by noting only the position 
of the barycenter, quality of the display depends on an extension of the light emission waveform. For example if two 
light emission wavefonns having the same barycenter as shown in Figs. 21 A and 21 B appear alternately as shown in 
Fig. 22, the luminance is modulated with the period twice the frame period, and flickers can be observed even if the 
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barycenter position is fixed. Furthermore, It is not sufficient for suppressing pseudo contours to control only the bary- 
center position. The change of the display when an object nnoves on the screen is shovy in Fig. 23. Fig. 23 shows a 
contour portion of an object having P gradation level moving on a background having Q gradation level. When a line 
of sight follows the movennent of the object, the image of the object stays on a retina, and the quantity of entering light 

s on the retina is distributed as shown in Fig. 24. Considering the lighting pattern, the integral quantity of light on the 
retina becomes as shown in Fig. 25. It is usual that there is a gap between the cells in a real cell arrangement. For 
example, a partition for defining cells forms a cell gap. In a color display using three color cells, there is a cell of another 
color between cells of a certain color, so that a gap con-esponding to two cells can bie generated. Considering this fact, 
the quantity of entering light on the retina when there is a cell gap is shown in Fig. 25. Fig. 25 shows the integral quantity 

10 of light in one frame made of plural subframes (denoted by SF in Fig. 25). Though there is no overlap of light emission 
profiles between the neighboring cells in Fig. 25, but it is not essential. The presence or absence of the overlap depends 
on a moving rate of the line of sight and a lighting pattern. 

[0009] Usually, the observation of the screen is perfonmed In the state where a cell pitch is smaller than the resolution 
of eyes. Therefore, light quantity profile on the retina shown in Fig. 25 is observed as being averaged in the space 

IS direction . In the display error that is a shift from the target light quantity, components having spatial frequencies above 
the cell pitch are not recognized. Components having spatial frequencies below the cell pitch mainly contributes to the 
pseudo contour, while the variation of sparse and dense of the space light emission profile corresponds to a dark 
portion and a bright portion. The variation of sparse and dense of the light emission profile cannot be controlled only 
by the barycenter of the light emission and Is affected by the expansion of the lighting pattern as shown in Figs. 26 

20 and 27. In Fig. 26, the light emission is concentrated in the middle portion of the projection area of the frame in both 
of the neighboring cells, so the pseudo contour is not conspicuous. In contrast, though the pattern shown in Fig. 27 
has the pattern of the barycenter of the light emission equal to the pattern shown in Fig. 26, the light emission of one 
of the ceils is unevenly distributed to the edge portion of the projection area of the frame. In this case, the variation of 
sparse and dense of the light emission intensity may occur between the neighboring cells and be observed as a pseudo 

25 contour. 

[0010] As explained above, from the viewpoint of the pseudo contour, the optimal lighting pattern is not always se- 
lected only by aligning barycenter positions. In addition, the conventional method in which only the individual cell is 
noted so as to make the lighting pattern vary little between the present frame and the past frame is not sufficient for 
reducing flickers and pseudo contours. 

30 [0011] Moreover, in the conventional method, it is necessary that a skilled person decide in accordance with expe- 
riences which lighting pattern should be selected for each gradation level when making a conversion table that connects 
a frame with subframes. If the relationship between the previous frame and the presentf rame is considered as explained 
above and the gradation number N is supposed to be 256, an optimal lighting pattern must be determined for each of 
2562 gradation levels with enonnous efforts. If two or more previous frames are referred, the combination of the gra- 

35 dation levels becomes up to N^. When the gradation number N is increased or the weight is changed, the change of 
the specification causes tiresome jobs every time. 

SUMMARY OF THE INVENTION 

40 [0012] According to the method of the present invention, the lighting pattem of the noted pixel is detemnined by 
refenring both the lighting pattern in the past frame neighboring in the time scale and the lighting pattem of the neigh- 
boring pixel so that flickers and pseudo contours are reduced. More specifically, the lighting pattern is detemnined so 
that the sum of the error calculated on the basis of Fourier components of a display error between the noted frame 
and the neighboring past frame and the error calculated on the basis of Fourier components of a display error between 

45 the noted pixel and the neighboring peripheral pixel becomes small. The pixel means a unit display element of a screen 
(a display element having a single light color). 

[0013] The display error from the past frame means the difference between the light emission wavefomn when a 
frame is divided into subframes for a display and an ideal light emission wavefomn. Fourier components of this display 
error are evaluated and the lighting pattern that makes the difference small is selected. On this occasion, since time 
50 resolution of eyes of human beings cannot recognize Fourier components having higher orders, weight is given to 
each order of the Fourier components for evaluating the error. This is effective for reducing flickers. 
[0014] The display error from the peripheral pixel means the difference between the target light quantity that Is ex- 
pected on the retina when the line of sight moves and a light quantity distribution derived from the Integral of the light 
emission of subframes. 

55 [0015] Though the effect can be obtained even If only one peripheral pixel Is referred, It is desirable that two or more 
peripheral pixels are referred. Namely, If only the pixel aligned In one direction of the screen is referred, mixture of 
lighting patterns when the line of sight moves in the other direction is not taken In consideration. Therefore, it is desirable 
to refer two or more pixels having different directions of anrangement with respect to the noted pixel. For example, the 
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lighting pattern may be determined by refenringthe pixel neighboring In the horizontal direction and the pixel neighboring 
m the vertical direction. However, it is necessary that the lighting pattem of the pixel to be reference must be detemiined 
before the reference, so the order of noting pixels is selected so as to satisfy the condition, In the form in which tl^e 
process is perfomied in parallel with the input of serial image data, it is natural to determine the lighting pattem in the 
order of inputting the image data, so as to think about the algorism of the data process easily. The pixel located at the 
edge o the screen does not have pixels to be referred in part or at all; Concerning such a pixel, an Imaginary pixel 
when all subframes are not lighted may be refen-ed for detennlning the lighting pattern, or only the pixels that can be 
refen-ed are referred for detemilning the lighting pattem. ' f 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] 

Fig. 1 is a block diagram of a display device according to the present Invention 

Fig. 2 is a diagram showing the relationship between positions of a noted pixel and peripheral pixels for detemiinina 
a lighting pattern. ^ 

Fig. 3 is a diagram showing an order of determining a lighting pattem in pixels arranged in a square arrangement 
Rg. 4 shows an example of a cell stmcture of a PDR 
Fig. 5 shows a general concept of frame division. 
Fig. 6 shows an example of the lighting pattem. 
Fig. 7 shows a target light emission wavefom. 

Fig. 8 shows a light emission wavefomn of one frame and a target light emission wavefomi 

Figs. 9A and 9B show the relationship between moving direction of the line of sight and the variation of the quantity 

of light entenng in the retina. ^ ^ 

Fig. 1 0 shows the relationship between weight setting and the flickers in a first example 

Fig. 11 shows the relationship between the weight setting and a pseudo contour in the first example 

Fig. 12 shows the relationship between movement speed of the line of sight and the pseudo contour in the first 

example. 

Fig. 13 shows the relationship between the weight setting and the flickers in a second example 

Fig. 14 shows the relationship between the weight setting and the pseudo contour in the second example 

Fig. IS shows the relationship between the movement speed of the line of sight and the pseudo contour in the 

second example. 

Fig. 16 shows the relationship between the weight setting and the flickers in a third example 

Fig. 1 7 shows the relationship between the weight setting and the pseudo contour in the third example 

Fia 18 shows the relationship between the movement speed of the line of sight and the pseudo contour in the 

third example. 

Fig. 19 shows the point of writing data into a subframe memory. 

Fig. 20 shows a schematic diagram of a screen in a delta an-angement. 

Figs. 21 A and 21 B are diagrams for explaining an expansion of the light emission waveform 

Fig. 22 shows a combination of lighting patterns In which flickers are conspicuous. 

Fig. 23 shows a variation of a display when an object moves on the screen. 

Fig. 24 shows the quantity of entering light on the retina when an object moves on the screen 

Fig. 25 shows the quantity of entering light on the retina when an object moves on the screen having a cell qap 

Fig. 26 shows a combination of lighting patterns in which pseudo contours are not conspicuous 

Fig. 27 shows a combination of lighting patterns in which pseudo contours are conspicuous. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0017] Hereinafter, the present invention will be explained more in detail with reference to embodiments and draw- 
ings. 

[0018] Fig. 1 is a block diagram of a display device according to the present Invention. Fig. 2 is a diagram showinc 
the relationship between positions of a noted pixel and peripheral pixels for determining a lighting pattem Fig 3 is a 
r^o?!^,"" t.""""^ ^" °^ detemilning a lighting pattem in pixels arranged in a square arrangement 
[0019] The display device 100 comprises a surface discharge type PDF 1 having a display screen including m x n 
cells and a drive unit 70 for selectively lighting cells arranged in a matrix. The display device 100 is used as a wall- 
hung television set or a monitor of a computer system. 

[0020] The PDF 1 includes display electrodes arranged in parallel forfomiing electrode pairs for generating display 
discharge and address electrodes arranged so as to cross the display electrodes. The display electrode emends in 
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the row direction (the horizontal direction) of the screen, while the address electrode extends in the column direction 
(the vertical direction). 

[0021] The drive unit 70 includes a controller 71 , a power source circuit 73, a data conversion circuit 75, an X-driver 
B1 , a Y-driver 85 and an A-driver 87. The drive unit 70 is supplied with frame data Df that are multivalued image data 
5 indicating luminance levels of red, green and blue colors together with various synchronizing signals from an external 
device such as a TV tuner or a computer. 

[0022] In a display using the PDP 1 , a binary lighting control is used for reproducing a gradation, so an original frame 
of a sequential input image is divided into a predetermined number M of subframes. The data conversion circuit 75 
converts the frame data Df into subframe data Dsf for a gradation display and send the subframe data Dsf to the A- 

10 driver 87. The subframe data Dsf is a set of display data of M screens, in which each cell corresponds one bit. The 
value oleach bit indicates whether light emission of the cell is necessary or not in the corresponding subframe, more 
specifically whether address discharge is necessary or not. The. data conversion circuit 75 includes a lighting pattern 
determining circuit 76, a subframe memory 77 for memorizing the subframe data Dsf for at least one frame and a table 
memory 78 for outputting the subframe data Dsf in a table look up fomnat. 

IS [0023] The conversion from the frame data Df(k) to the subframe data .Dsf(k) in the k-th frame to be displayed is 
performed one by one pixel in the order shown in Fig. 3. The letter in parentheses indicates the frame order. When the 
subframe data Dsfj(k) of the noted pixel j is determined, subframe data Dsfj(k-1) of the past frame including at least 
(k-l)th frame and subframe data Dsfa(k) and Dsfb(k) of the k-th frame that were already determined for peripheral 
pixels a and b that are located in the vicinity of the noted pixel j are inputted to the lighting pattern determining circuit 

20 76 as reference data. The lighting pattern determining circuit 76 reads the subframe data Dsfj(k) corresponding to a 
combination of data value of the noted pixel j and a reference data value in the frame data Df(k) of the noted pixel j 
out of the table memory 78, and the subframe data Dsfj(k) are written in the subframe memory 77. The data contents 
of the table memory 78 are set so that the Fourier component of the error with respect to the target value becomes 
the minimum value. It is possible to replace the table memory 78 with an operational processor, which calculates an 

25 optimal subframe expression by Fourier operation responding to an input. 
[0024] Fig. 4 shows an example of a cell stmcture of a PDR 

[0025] In Fig. 4, the PDP 1 comprises a pair of substrate structures (the structure includes a substrate on which cell ' 
elements are disposed) 10 and 20. On the inner surface of the glass substrate 11 that is a base of the front substrate 
structure 10, display electrodes X and Y are an-anged so that a pair of the electrodes X and Y corresponds to one row 
50 of the display screen ES having n rows and m columns. The display electrodes X and Y includes a transparent con- 
ductive film 41 for fomning a surface discharge gap and a metal film 42 that is overiaid on the edge portion of the 
transparent conductive fjim 41 . The display electrodes X and V are covered with a dielectric layer 17, which is coated 
with a protection film 18. 

[0026] On the inner surface of the back glass substrate 21 , address electrodes A are arranged so that an address 
35 electrode A corresponds to one column. The address electrodes A are covered with a dielectric layer 24. On the 
dielectric layer 24, partitions 29 having the height of approximately 1 50 microns are disposed. A partition pattern is a 
stripe pattern for dividing a discharge space into plural columns. The surface of the dielectric layer 24 and the side 
faces of the partitions 29 are covered with fluorescent material layers 28Ri 2BG and 2BB for a color display. Italic letters 
(R, G, B) in Fig. 4 indicate light emission colors of the fluorescent materials. A color arrangement is a repeating pattern 
40 of red, green and blue, in which cells in a column has the same color. In other words, three columns (three cells) in 
one row correspond to one pixel of a display image. The fluorescent material layers 28R, 28G and 28B are locally 
excited by ultraviolet rays emitted by a discharge gas so as to emit light, 

[0027] Fig. 5 shows a general concept of frame division. Fig. 6 shows an example of the lighting pattern. 
[0028] In order to reproduce each color by the individual gradation display, a frame is divided into twelve subframes, 
45 for example. Namely, a frame is replacedwithtwelvesubframessf1-sf12.The ratio of luminance levels of the subframes 
is set to approximately 5:16:59:32:3:7:2:1:22:9:43:56 by weighting, so that the number of display discharge times in 
each subframe is set. By combining on and off of each subframe, 266 steps of luminance levels can be set for each 
color of red, green or blue. 

[0029] The display frame period Tf is divided into subframes, and subframe periods Tsfl -Tsf 1 2 are assigned to each 
50 subframe. Each of the subframe periods Tsf1-Tsf12 is divided into a preparation period TR for equalizing charge dis- 
tribution in the whole screen, an address period TA for forming a charge distribution corresponding to display contents 
and a display period TS for sustaining a lighted state for securing a luminance level corresponding to a gradation level. 
The lengths of the preparation period TR and the address period TA are constant regardless of the luminance weight, 
while the length of the display period TS is longer as the luminance weight is larger. 
55 [0030] As shown in Fig. 6, in a display of the gradation level 1 26 (= 59 + 2 22 + 43), the lighting pattern that turns 
on four subframes sf3, sf7, sfS and sf11 is selected. 

[0031] Hereinafter, a data conversion method for optimizing a lighting pattern will be explained. 
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[Example 1] 



? . f noted If there is no cell In the referred position, only cells that can be referred are referred 
[0033] First, evaluation of Fourier component for reducing flickers will be explained. It Is supposed thatthe luminance 
level to be displayed ,s f,. Here, k denotes the number of the frame. The number of the frame whose lighUngTattem 
will be detemrned is denoted by k, and the number of the previous frame Is denoted by k-1 . In this case anKght 

beeves constenT " ^ '° ^'^'^ "^'^ '"^^"^'^ ''"^^^^^ 

[0034] The light emission intensity of the i-th subframe in the k-th frame is denoted by r^S, the start point of the disolav 
period IS denoted by a^. and the end point of the display period Is denoted by pK, (see Fig. 8). The urStTthe time sc^e 
s the frame penod. and origins of a^ and p^, are set to the head of the k-th^r^^e. Conceming ^^ evfry f Tme h^^^ 
the same subframe structure, and the luminance level when the i-th subframe is lighted by Itself Is denoted bTf ^ 
Then the following equation is used for normalization. y 'iseir is aenotea by fsp"^,. 



ISF7=11 /(P /-«/) 



(1) 



[0035] If the period of the display discharge is not changed for every subframe. ^\ also has a substantially constant 
value regardless of the subframe. The subframe structure can be different for each frame "^^^"^'^''y 
thf/^iJI^ expansion into^Fourier series is performed in the period of two sequentlai.frames. i.e., the k-th frame and 
the (k-1 )th frame. The coordinate in the time axis when the unrt is the frame period is denoted by t the origin of t^e 
coordinate ,ssettotheheadofthek-th frame, andthebasisfunction system isset as showninthefollowi^^^^^^^^ 



j-j , cos(n.;r t), sin(n7r t)| (2) 



30 [00371 The lighting pattern of the subframe in the k-th frame is determined so that an error of the light emission 
between the light emission wavefonn and the target waveform. 

[0038] Supposing thatthe light emission wavefomn is <j,(t) and the target light emission waveform is f(t) the Fourier 
expansion of the error in two frame periods of the (k-1 )th frame and the k-th frame Is given as followl 



<P(t) - f(t) - f + 1 (a„cos(n^ t) + b„ sin(n^ t )) 
[0039] Here, the coefficients are defined as follows. 

a„ =/^(</>(t) -f(t))cos(n;r t) dt (n = 0,1,2,....) 
K =jj(<^(t)-f(t))sin(n^t)dt (n = l,2,....) 



(3) 



(4) 



55 



whl^Jho'lI^'^H^ is supposed that the light emission waveform is>(t) and the target light emission waveform is f«<(t) 

tTe f^l ow,nn°int'" i°"r;' °' ''^^^ "'"^ '"""^ ^ ""'^''^^ °^ this case 

the following integral is defined for each frame. 
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a\ "Jo C^" (0 -^(0)0)8(0^ t)dt (n = 0,1,2 ) 



(5) 



10 



15 



h\ «jj((^*(t)-f '(t))sin(njr t)dt (n.= l,2,....) 
[0041] Using the equations (5), tlie coefficients defined by the equations (4) can be rewritten as follows. 



[0042] Next, the integral shown in the equation (5) will be calculated. 

[0043] First, the lighting pattern of the subframe in the k-th franne is denoted by 5*«(i). When the i-th subframe is 
lighted, S'^(i) = 1 , while 6'^{i) = 0 when the i-th subframe is not lighted. In addition, a function having the value one only 
in the period from a to p and the value zero in the other periods is defined by S(t;a, p), (t) in the k-th frame period 
20 can be written as follows. 



^*''(0 = ^^*OV.•5(^;«^,y5^ 



25 



[0044] Here, the letter denotes the total number of the subframes in the k-th frame. 
[0045] On the other hand, f*^(t) in the k-th frame period is expressed as follows. 

30 y 

f'(t) = fk (8) 

[0046] Thus, the following equations are derived. 



35 



40 



say 

0 = g^'(i)fsF'i-fK 

i^c = ^—j^ (5''(i)J7^(sin(n7r^^)-sin(nJ^a^)) (n =1,2,...) 



(9) 



50 



= -^;^j^«5''(i)77''i(cos(n;r^N)-cos(njraN)) 
+ (:;^]fk((-i)"-i) (n=.l,2,...) 



[0047] From these equations and the equation (6), the Fourier coefficient can be obtained. If the display device has 
the gradation number capable of expressing the gradation number of an input signal, a\ and b^^ are determined by 
the lighting pattern. Therefore, a conversion table can be made in advance. 
55 [0048] Next, the errorof the light emission distribution that can be sensed by eyes of a human being will be considered. 
When the sensitivity of eyes of a human being (or a quantity proportional to the sensitivity) to frequencies of the Fourier 
components is denoted by the error with weight of the light emission waveform within the two frames that can be 



7 



EP 1 288 893 A2 

sensed by eyes of a human being is expressed by the following equation using the weight 

Eh (0 - Y j + ^ ^„ (a„cos(n^ t) + b„sin(n^ t)) (1 0) 
[0049] The root-mean-square value of this error within the two frames Is calculated as follows. 

[0050] Usually, the frame frequency Is set to a frequency at which flickers are not sensed. Namely, since the sensitivity 

of eyes to the components above frame frequency is very bad, the approximation of the equation (11)can be performed 
as follows. ^ 



E%=^C^or(^)' + (lir((aJ^+(b,)^) (12) 

[0051] Here, If the display device Is capable of expressing the gradation number of an Input signal and the display 
IS performed faithfully to the gradation of the inpu^ signal. = 0. and the equation (1 2) can be rewritten as follows. 

t 
f 

E'^p=J(a,f + (b,f (13) 

[0052] The weight is meaningless In the equation (1 3) when the lighting pattern is selected, so It is omitted The letter 
p denotes the number of the cell under consideration. 

[0053] Next, the Fourier component of the display error of the noted cell from the neighboring cells in the frame that 
IS projected onto the retina in the space direction when the line of sight moves will be explained. The movement of the 
line of sight is not limited to the case where the mc^ement of an object is followed, but can be the case where a qazed 
point on the screen moves. j ' 

[0054] The frame under consideration Is the k-th frame. The suffix for Indicating the frame is omitted. The luminance 
level to be displayed is denoted by fp. Here, the letter p is the number of a cell. In a color display, cells having the same 
color are considered. There are two types of melthod for mixing the lighting patterns depending on the movement 
direction of the line of sight as shown in Fig. 9A and Fig. 9B. A movement speed of the line of sight is denoted by U 
and the direction is considered to be positive in the case shown in Fig. 9A. The movement speed of the line of sight Is 
expressed by the number of cells per frame. 

[0055] The coordinate on the retina is denoted tjy x, and a cell pitch in the movement direction of the line of sight Is 
used as a unit. Then, the cell whose lighting pattern Is being determined is denoted by p, and the cell that will be 
referred is denoted by p'. It Is supposed that the center coordinate x of the Image of the cell p projected onto the retina 
IS 1/2, and the center coordinate x of the image of the cell p' projected onto the retina is -1/2. In addition, cell width in 
the movement direction of the line of sight is used as a cell pitch unit W. In a cell having an RGB stripe structure, W is 
equal to 1/3 when the line of sight moves In the horizontal direction, while W is equal to one when the line of'siaht 
moves in the vertical direction. 

[0056] The projected Image (t)'P,(x) of the cell p In the i-th subframe is expressed by the following equation. 
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<*"',(x)= /^'-^S(x;AU + i(l-U-W),AU + -(l-U + W))dA (14) 

5 

[0057] When the lighting pattern of the cell p Is denoted by 6^(1), the projected image ^'^{x) of the cell p is expressed 
by the following equation. 

10 

M 

(^'''(x) = g«5''(i)9>'''i(x) (15) 

15 [0058] The pseudo contour is generated by the variation of sparse and dense of the light emission distribution as 
shown in Fig. 27. This variation of sparse and dense corresponds to the component of the double period of the cell 
pitch in the Fourier expansion of the distribution when the lighting patterns of two neighboring cells are an-anged al- 
ternately and repeatedly. However, since the component of the double period of the cell pitch due to the difference 
between the gradation levels of the cells is not related to the variation of sparse and dense, the portion thereof is 

20 omitted. Namely, it is sufficient to evaluate the Fourier component of the difference between the light emission distri- 
bution and the target light emission distribution. 

[0059] Similarly to the case where the flickers are evaluated, the basis function system over the cell p whose lighting 
pattem is being determined and the cell p' to be referred is defined as follows. 



25 

1 



^ , cos(n;T x), sm(ii^ x) 



(16) 



30 [0060] Under this basis function system, the difference between the light emission distribution <t)'(x) and the target 
light emission distribution f (x) is processed by the Fourier expansion as follows. 



55 ' <P'(?0 - f '(x) = Y + ^ (a;cos(n^ x) + b^sinCii^r x)) 

[0061] Here, the coefficients are defined by the following equations. 



(17) 



40 
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< =/^(<*'(x) - f tx))cx3s(iL7r x)dx (n = 0,1,2, ....) 

K =f^(<P'(?0-f'(^))sm(im x)dx (n -1,2,...) 



0 8) 



[0062] The light emission distribution (j)'(x) when the lighting patterns of the cell p and the cell p' are arranged alter- 
nately one by one cell can be expressed as follows. 



,p'(x) = 2 (X - 2j) + <p'^' (X - 2j + 1)} (-1 5 X :S 1) 



(19) 



55 [0063] Therefore, the integral of each lighting j^ttern is defined as follows. 
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^fij,/'^^ " 2i) cosCn^r X) dx -J^f '(x)cos(n^ x) dx (n « 0,1,2, ...) 

" 2j) sm(n^ X) dx - '(x)sin(n;r x) dx (n =1,2,, .„) 



(20) 



70 



[0064] Then, the coefficient in the equation (18) can be written as below. 



15 



a:«a'P„+(.l)°a'^ 

K«b'Pn+(-l)°b'P'n 



(21.) 



[0065] When the target light emission intensity of the cell p is denoted by fp, the following equation is satisfied In the 
period of the cell p. 
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f'(X)=:fp (0<X<1) 

[0066] When perfonning the integral of the equation (20). the following equations are derived. 



55 



M 

l'''0=g<5''(i)f3,,-f'P 



- cos(njr(fi.V + -(1- U + W))) 
+ cos(iwr(;ff, U + -| (1 - U - W))) 



+ cos(iwr(ai U + - (1 - U + W))) 

2 



■ cos(njr(a,U + - (1 - U - W))) 



H-(-i-y^((-i)".i) 



■siii(n^(yg.U + -(1- U + W))) (n =1,2, ....) 

1 

+ sin(n^(/?. U + - (1 - U - W))) 
2 

+ sin(n;^(aiU + •-■ (1 - U + W))) 



- sin(n^(aj U + - (1 - U - W))) 



(22) 



(23) 



[0067] If the preset gradation level of the cell is equal to the target gradation level, a'^o is equal to zero. If the display 
device has a gradation number capable of expressing the gradation number of an input signal, a'P^ and b'^^, are de- 
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termined by the lighting pattern, so that the conversion table can be prepared in advance. 

[0068] Since the component having the double period of the cell pitch corresponds to the case of n - 1 , the variation 
of sparse and dense of the light ennission distribution can be evaluated by the following equation. 

E'V=V(ai)' + (bi)' (24) 
[0069] This value does not depend on the sign of U. 

[0070] It is supposed that the reference ceil in the horizontal direction is denoted by p' and the reference cell in the 
vertical direction is denoted by p". Supposing that the error between the flicker connponents in the k-th franne and the 
(k-1)th frame of the cell p is given by the equation (13), the lighting pattern of the cell p is detemnined so that Es given 
by the following equation becomes the minimum value. 

Es = ;e'^p + ?'E''^pp. + C"eV (25) 

[0071] Here, C'. and C denote weights. The weight Is changed depending on which of the flicker and the pseudo 
contour is more important. The right-hand side of the equation (25) is a function of the lighting pattern of the cell p in 
the (k-1 )th frame and the lighting pattern of the cells p, p' and p" in the k-th frame. The lighting patterns are detemnined 
in the order shown in Fig. 3, so that when the lighting pattern of the cell p in the k-th frame is detenmined, the other 
lighting pattems are already determined. 

[0072] The movement speed U of the line of sight depends on the circumstances and the value of Es also depends 
on the value of U. In a typical case, the value of Es when U is equal to two (i.e., the movement speed of the line of 
sight corresponds to two cells per frame) Is evaluated for determining the lighting pattern. The left neighboring cell and 
the upper neighboring cell are refen^ed as shown in Fig. 2. 

[0073] The comparison of the flickers as well as the pseudo contours is perfonned between the two cases; in the 
first case the lighting pattern is detemnined in advance so that the position of the barycenter is aligned as much as 
possible (i.e., a barycenter fixing method), and in the second case the lighting pattern is determined by the method 
according to the present invention. 

[0074] It is supposed that the following equation is satisfied. 

^' = ;" = (1-Q/2 (26) 
[0075] Here, the subframe an-angement is {48, 48, 1 , 2. 4, 8, 1 6, 32, 48, 48}. 

[0076] The flicker is evaluated by the two-frame period component when the display having r gradation level and the 
display having r-1 gradation level are repeated one by one frame, i.e., value of the equation (13). The gradation level 
is used for nomnalization, so that the average value of 255 cases where r = 1 through r = 255 is calculated. The result 
is shown in Fig. 10. As a reference, the barycenter fixing method is shown in Fig. 1 0. It is understood that the present 
invention has the effect despite of the value of ^. 

[0077] Next, the pseudo contour will be evaluated. The pseudo contour is evaluated in the case where a vertical 
band having r gradation level and a vertical band having r-1 gradation level are displayed side by side and are scrolled 
in the horizontal direction, as well as in the case where a horizontal band having r gradation level and a horizontal 
band having r-1 gradation level are displayed in neighboring manner and are scrolled in the vertical direction. In each 
of the cases, the maximum value of the error from the target light emission level is nonnalized by the average gradation 
level. The average of all cases where r = 1 through r = 255 is calculated. Approximation of the spatial frequency 
characteristics of eyes is performed with Butterworth characteristics (a low pass filter) having the cut off frequency of 
11 c/deg and the order of 3.3. It is supposed that the observation is perfonned under the condition where the period 
of the cell pitch is 50 c/deg. The effect of reducing the pseudo contours to the weight ^ is shown in Fig. 11 . This Is the 
case where the scrolling speed is 4 cells per frame. It is understood that the present invention has the effect also in 
reducing the pseudo contours. It is understood from Fig. 11 that the effect of reducing the pseudo contours can be 
obtained in the area where ^ is below 0. 4, The case where ^ is equal to zero corresponds to the case where only the 
lighting pattern of the neighboring cell is referred for detennining the lighting pattern. As understood from Figs. 1 0 and 
1 1 , it is more effective in reducing flickers and pseudo contours to refer also the lighting pattern of the past frame than 
in the case where it is not referred. 

[0078] The effect of the reduction to the movement speed of the line of sight (i.e., the scrolling speed) is shown in 
Fig. 12. The evaluation of the equation (25) when determining the lighting pattern is performed under the condition 
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where the scrolling speed is two cells per frame. However, the effect of the reduction can be obtained regardless of 
the scrolling speed. 

[0079] Though a display using a PDP is illustrated, the present invention can be effectively applied to other displays 
(e.g., an organic EL) that utilize the subframe technique. 

[Example 2] 

[0080] Though Fourier component is evaluated for determining the lighting partem in the first example, it is possible 
to detemnine the lighting pattern so as to be similar to the lighting pattern of the reference pixel as much as possible 
10 Considenng the case where the subframe structure is constant regardless of the frame, the equation (13) can be 
rewritten as follows using the equation (9). 
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(e'pN[^) |||{'5'(i)-<5''■'(i))»7^(si^(^;8^)-sm(;^a^))|' 

[0081] FurthetTTiore, the equation (24) can be rewritten as follows using the equation (23). 

^ (I 

+ ||(«5>'(i)-c5''(i)) 7,S„-2(f'»-f'0| j 
[0082] Here, the following equations are satisfied. 

C„ = - cos(;r U + (1 - U + W))) + cos(jr U + i (1 - U - W))) 
+ cosQi(a, U + i (1 - U + W))) - cos(,w(aj U + i (1 - U - W))) 

=-sin(7r(/ffiU+^(l-U + W))) + sin(^((5.U + i(l-U-W))) 

Z 2 

1 1 
+ sm(^(ajU + - (1 - U + W))) - sin(jr(a.U + -^(1 - U - W))) 
Z 2 

[0083] 6''(i) and 5P(i) denote the lighting patterns. Approximately, the closer to the lighting pattern of the past frame 
IS, the smaller the value of the equation (27) is. The closer to the lighting pattern of the neighboring cell is the smaller 
the value of the equation (28) is. 

[0084] Therefore, a simplified method Is possible in which the lighting pattem is determined so that the following 
equation has the minimum value, instead of evaluating the equation (25). 



(29) 
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Es = ^{||^^(i)-^"®b.}-^r||>''(i)-<5''(i)^|+r||^ 

5 

[0085] The equation (30) indicates the sum with weight of absolute value of components of difference vectors between 
the reference ceii and the ceii whose lighting pattern is to be detemiined when lighting pattem is regarded as a vector. 
[0086] In other words, the equation (30) indicates the sum of distances of the lighting pattern between the reference 
cell and the cell whose lighting pattern is to be determined when the lighting pattern is regarded as a coordinate value. 
10 [0087] The effects are shown in Fig. 13, Fig. 14 and Fig. 15, It is understood to have the effect equal to the first 
example. 

[Example 3] 

15 [0086] There is another method in which the sum of the equation (30) is calculated only for the subframes having a 
long light emission time by further simplifying the second example. The following equation is evaluated in which a set 
of the numbers of the selected subframes having a long light emission time is denoted by a. 



20 



(31) 



25 [0089] Namely, in the method, a combination of on and off of some subframes of one frame (a partial lighting pattern) 
is noted for detemnining the lighting pattem. 

[0090] The effects when the partial lighting pattern of five upper subframes is considered are shown in Figs. 1 6. 1 7 * 
and 1 8. It Is understood that the effect of this example is substantially equal to the effect of the first example. The partial 
lighting pattem can be different in each lighting pattern to be referred. 



30 



35 



[Example 4] . 

[0091] There Is another method in which the approximation of the equation (31) is further perfonned so that the 
evaluation of the weights of subframes is omitted and the evaluation of the following equation is perfonned. 



40 



; |5 Hi) - c5 (i)| j f t ' || |5 ^ (i) - c5 ^" (i)|| + C " |g \d ^(1)^3 (i)| 



C32) 



[0092] Next, an example of using the subframe memory 77 for memorizing the lighting pattern will be explained. 
[0093] The lighting pattern is detemnined in the order of inputting the image data. In the case of a color display, the 
process is performed for each of red, green and blue colors. The following explanation is about the case of one color. 

45 [0094] Fig. 19 shows a frame memory in the fonn of cell arrangement of a screen. Arrows in the figure shows the 
order of determining a lighting pattern. Fig. 19 shows the state where the lighting pattern in the k-th frame is determined 
for up to the cell p'. The next stage is that the lighting pattern of the cell p is determined. The frame memory memorizes 
the reference lighting pattern of the cell p in the (k-l)th frame and the reference lighting patterns of the cell p' and the 
cell p" in the k-th frame, which are read out for determining the lighting pattem of the cell p in the k-th frame. When 

50 the lighting pattern of the cell p in the k-th frame is detemnined, the lighting pattern of the cell p in the k-th frame is 
memorized in the place of the cell p in the (k-1)th frame, followed by detemnining the lighting pattern of the next cell. 

[Variation 1] 

55 [0095] The cell arrangement Is not limited to the square an-angement like a cross grid as shown In Fig. 2 but can be 
a delta arrangement as shown In Fig. 20. Fig. 20 shows an example of the relationship between positions of the noted 
cell and the neighboring reference cell. 

[0096] While the presently preferred embodiments of the present invention have been shown and described, it will 
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be understood that the present invention is not limited thereto, and that various changes and modifications may be 
made by those skilled in the art without departing from the scope of the invention as set forth in the appended claims. 



Claims 



A method for displaying an image In which a halftone is reproduced by a subframe techniqueof converting a frame 
into a plurality of subf rames. the method comprising the step of detenmining a lighting pattem that is a combination 
of on and off of the subf rames for each of pixels of a display screen In accordance with a frame data value of a 
noted pixel, a lighting pattem of the noted pixel in the past frame and a lighting pattem determined for a peripheral 
pixel that IS located in the vicinity of the noted pixel and has the same display color as the noted pixel. 

A method as recited in claim 1 , further comprising the step of referring a lighting pattem of plural peripheral pixels 
arranged in the directions different from each other with respect to the noted pixel. 

3. A method as recited in claim 1 , further comprising the steps of: 

.determining intensity values of Fourier components of the difference between the light emission waveform 
indicated by the lighting pattem In the past frame and a target light emission waveform indicated by the frame 
data value; 

yetemnining intensity values of Fourier components of a light emission distribution en-or between the periDheral 
pixel and the noted pixel; and ^ 

detemnlning a lighting pattem of the noted pixel so that the sum of the intensities after being weighted becomes 
the minimum. 
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A method as recited in claim 3, wherein the weight of the Fourier components having a frequency above a flicker 
frequency is set to zero among the Fourier components of the difference between the light emission waveform 
indipated by the lighting pattem in the past frame and the target light emission waveform indicated by the frame 
data value. ' 

5. A method as recited in claim 3, wherein the step of determining a lighting pattern uses only the components cor- 
responding to the period twice the pixel pitch among the Fourier components of the light emission distribution error 
between the peripheral pixel and the noted pixel. 

6. A method as recited in claim 1 , wherein the lighting pattem of the noted pixel is determined so that the difference 
between the lighting pattem in the past frame and the lighting pattem determined forthe peripheral pixel becomes 
the minimum value. 

7. A method as recited in claim 6, wherein the lighting pattem of the noted pixel is determined so that the sum of the 

distance to the lightingpattem of the pastframeandthe distance to the lighting pattem determinedfortheperipheral 
pixel becomes the minimum when a lighting pattern is regarded as a coordinate value. 

8. A method as recited in claim 1 , further comprising the steps of noting only a part of the plural subf rames so as to 
refer the lighting pattern of the past frame and the lighting pattem detennined for the peripheral pixel and deter- 
mining the lighting pattern of the noted pixel so that the difference to the referred lighting pattern becomes the 
minifnum value. 

9. A method as recited in claim 8, comprising the steps of noting only a part of the plural subf rames so as to refer 
the lighting pattem of the past frame and the lighting pattem detemiined for the peripheral pixel, obtaining the 
lighting pattem as a coordinate value, and determining the lighting pattem of the noted pixel so that the sum of 
the distance to the lighting pattem in the past frame and the distance to the lighting pattem detennined for the 
peripheral pixel becomes the minimum value. 

10. An image display device that can reproduce a halftone by a subframe technique in which a frame is converted into 
plural subframes, the device comprising: 

a memory having a capacity of at least one frame for memorizing lighting pattem data for determining a se- 
lection of on or off of pixels of a display screen; and 
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a lighting pattern determining circuit for receiving input of franne data of the n-th frame, receiving input of lightinjg 
pattern data of the noted pixel in the (n-1)th frame and the lighting pattem data of the n-th franne detennined 
for a peripheral pixel that is located in the vicinity of the noted pixel and has the same display color as the 
noted pixel and for outputting data that is associated with a combination of input data values in advance as 
5 the lighting pattem data of the noted pixel in the n-th frame. 
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FIG.1 
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FIG.2 
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FIG. 4 
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FIG.5 
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FIG. 7 
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FIG.9A 
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FIG.12 
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FIG.14 



BARYCENTER FIXING METHOD 



0.5 



CO 
a- 




EXAMPLE 2 



MOV£MENT SPEED OF THE 
LINE OF SIGHT = FOUR 
CELLS PER FRAME 



0.2 



0.4 

4- 



0.6 0.8 



FIG. 15 



O 1.5 



o 



o 
o 



CO 



0.5 



0 



barycenter fixing 
'method 

i 




EXAMPLE 2 



0 1 2 3 4 5 
MOVEMENT SPEED OF THE LINE OF 
SIGHT ( CELL PER FRAME ) 



24 



BP 1 288 893 A2 



FIG. 16 

4 



- 2 

—I ^ 



\ 


A 

'EXAM 


'LE3 



0.2 0.4 0.6 0.8 1 



- BARYCENTER 
FIXING METHOD 



FI6.17 



BARYCENTER FIXING METHOD 



1.5 



o 



CO 



0.5 



EXAMPLE 3 

MOVEMENT SPEED OF 
THE LINE OF SIGHT = 
FOUR CELLS PER FRAME 



0.2 



0.4 0.6 



0.8 1 



25 



EP 1 288 893 A2 



FIG. 18 
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FIG.20 
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FIG. 23 
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FIG. 26 
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□ SKEWED/SLANTED IMAGES 



□fcOLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBrr(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 
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